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Abstract. Finite-size fluctuations in coevolutionary dynamics arise in models of biological as 
well as of social and economic systems. This brief tutorial review surveys a systematic approach 
starting from a stochastic process discrete both in time and state. The limit N — > oo of an 
infinite population can be considered explicitly, generally leading to a replicator-type equation 
in zero order, and to a Fokker-Planck-type equation in first order in XfJN. Consequences and 
relations to some previous approaches are outlined. 

1. Introduction. Evolution is a biological process ubiquituosly taking place, acting on 
on several temporal, spatial, and taxonomic scales. Biological organisms are coded by 
their genetic sequence, and their ability to survive, following Darwin, is largely deter- 
mined by their genes. However, even the relationship between genotype, phenotype and 
a fitness (e.g., defined by the reproduction rate) by no means is simple, as it maps an 
enormously high-dimensional space (the state space of all possible genomes) to a much 
lower-dimensional phenotype space, and finally to a one-dimensional space of fitness val- 
ues. 

The extinction of species, as observed in the fossile record, follows a complicated 
behaviour [Eld72j including intermittency-like long periods of stasis, the so-called "punc- 
tuated equilibria" . It is still at debate whether external or cosmic influences account for 
these, or whether a purely dynamic mechanism of the evolutionary and ecological dynam- 
ics can produce this stylized fact. In this direction, the Bak-Sneppen model Bak93] is a 
pioneering minimal model for the extinction of species, which however is difficult to relate 
to the biological scenario. On the one hand, it provides an intermediate modeling level, 
where biological observations can be explained to some extent, but on the other hand, 
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a mathematical treatment is still possible Ban05, Pis97 . On an individual-based level, 
the Tangled Nature model |Jen04j approaches closer to biology. While the dynamics at 
large will deserve some further decades of research, simplified situations of coevolutionary 
dynamics, restricting to a finite number of species can be studied by formal models of 
evolutionary processes, and can be solved analytically in many cases to allow for an exem- 
plaric insight. In this brief tutorial review, coevolutionary dynamics in finite populations 
is formulated within the framework of evolutionary game theory, providing a convenient 
common mathematical framework for biological, social and economical evolutionary pro- 
cesses of strategies, or genetic types. 

1.1. Game theory: The strategy of conflict. Game theory was brought into play by von 
Neumann and Morgenstern |Neu53j as a minimal model to explain and predict the be- 
haviour of humans in strategic situations, be them military or economic, assuming fully 
rational behaviour. In game theory, more specific in two-player normal form games, agents 
1 ... N "play" a strategy, out of a finite set of possible pure strategies. They interact with 
a partner also playing one of those stragegies, and both receive a (real valued) payoff ac- 
cording to a so-called payoff matrix. This is best illustrated with an example. The most 
paradigmatic conflict situation described in game theory is the Prisoner's Dilemma. It is 
defined by the payoff matrix 



This is to be read as follows. The game is defined between two players, who can adopt two 
possible strategies: to cooperate (C) or to defect (D). The players act in parallel and are 
not informed about the opponent's move. Each player P (row player) playing strategy i 
then receives the payoff -Kij when meeting a player using strategy j (column player, O) as 
opponent. Obviously, here the conflict situation is symmetric, therefore the payoff matrix 
of the opponent's payoffs is given by the transpose irjy Often both payoff matrices are 
combined to 



In symmetric conflicts, thereby only redundant information is added. In asymmetric con- 
flicts, for obvious reasons often called bimatrix games, the opponent's payoffs, in general, 
can be different. We will analyze such cases in Section [BJ 

In all cases above, the players play their respective strategy with probability one, i.e., 
they play pure strategies. A straightforward generalization is that players — in a random 
and uncorrelated manner — can use mixed strategies, or strategy profiles s n , i.e., possess 
a strategy vector (with components (s n )i summing up to one, thus are elements of a 
simplex S n ), and gain payoffs which are the corresponding linear combination 
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for playing against one opponent (profile) s„, and 
(4) u n (s n , {s m }) = )Xs n )i'< 
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against a set of opponents indexed by m. Now, can mixed strategies exist that are suc- 
cessfull against all hypothetical sets of opponents? This brings us to the central concept 
of a Nash equilibrium }Nas51| : A Nash equililbrium is a mixed strategy, in which no single 
agent can improve its payoff by solely changing its own strategy. 

1.2. Nash equilibria. A strict Nash equililbrium (resp., Nash equililbrium) is defined as a 
strategy profile s* — (s*, . . . s* N ) for which each agent's strategy s n is a best (resp., best 
or equal) response to the strategies of the other players s*_ n , i.e. 

(5) V„V se s„, s ^ s * u n (s*,sl„) > u n {s,s*_ n ) 

where > instead of > must hold for a strict Nash equilibrium. 

Hereby sl„ :— (si, . . . s n _i, s n +i, ■ ■ ■ sn) is called a strategy profile of the co-players (for- 
mally a set of N — 1 profiles, usually it is understood that playing against all co-players 
linearly sums the payoffs received playing with each of them; so one can define the co- 
profile {s*_ n )k ■= (N — J2i^ n ( Si ) k as a l mear ly averaged profile of the co-players; or 
define u n (., s*_ n ) as the sum of payoffs against the profile of each co-player). 

Nash's theorem [Nas51] ensures that a normal-form game (as defined above) for a 
finite number of strategies and a finite number of players always posesses a Nash equi- 
librium. However, it can be degenerate or a mixed strategy (mixed Nash equlibrium). In 
the above Prisoner's Dilemma, ((1, 0), (1, 0)), i.e. both players playing always "defect", is 
a Nash equlibrium; hence two memory-less agents playing it for one round have no incen- 
tive to cooperate. Conversely, the Stag-Hunt game 7Ty = ( jj |j ^ has two symmetric; 

((1,0), (1,0)), and ((0, 1), (0, 1)) the Hawk-Dove game Try = yj 2 ) with 

C > V has two nonsymmetric Nash equilibria, ((1, 0), (0, 1)) and ((0, 1), (1, 0)), the latter 
is an example of a population where both strategies are present. 

1.3. Evolutionary Game Theory and evolutionarily stable strategies. Decades after game 
theory was invented, Maynard Smith and Price |May73| were the first to utilize its ap- 
proaches to the understanding of biological conflict situations among whose the emergence 
of cooperation [Axe84j among animals and humans still is a continuously active field. In 
the dynamical picture of evolutionary game theory, the concept of the Nash equililbrium 
has its counterpart in the evolutionarily stable strategies (ESS), which are defined as 
a population in which a single mutant (changing to any of the possible strategies or 
genotypes) cannot invade the population. In infinite populations, traditionally described 
within the framework of replicator equations |Tay78[ [Hof 79 , Zcc80 , ESS appear as stable 
fixed points (see |Hof98| for a systematic treatment). In finite populations, however, this 
concept has to be refined |Now041 |Tay04[ INei041 IWil04[ ITra06bj . For a more detailed 
introduction into the field of evolutionary game theory, and its recent development, see 
the classical textbooks [Hof84, Hof98] and recent reviews )Sza07[ lMie07j . 
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2. Microscopic interactions: Game theory based on particle collision models. 

The description of social agent behaviour as interaction, or collision, of particles has 
been studied by Helbing establishing a quite general framework Hel92a, Hel 92b[ [Hel96j . 
which at that time had not further been taken up within evolutionary game theory or 
evolutionary dynamics. 

One main limiting assumption of the mean-field type description discussed in the next 
sections is that any spatial organization can be neglected in a first order approximation. 
This approximation, as well as neglecting age structure and time delay |Alb04| . however 
is not warranted in general. 

2.1. Patchy ecosystems. To describe the full dynamics of ecological and evolutionary 
processes, it can be necessary to split up the population into parts, or patches, and to 
investigate an intermediate level of subdivided populations [Che03j or metapopulation 
dynamics [Har02 . In general, a rich variety of dynamical scenarios can emerge; thus 
simplified models on lattices and graphs have been investigated widely. 

2.2. Spatial models. Life typically is organized, to a very rough approximation, as a cov- 
ering of the surface of earth, in competition for sunlight, solid ground, or hunting ter- 
ritory. So it is natural to investigate evolutionary dynamics of individuals located in 
a two-dimensional space |Now92] . where collective phenomena can emerge |Her94] . An- 
nothcr classical study by Lindgren and Nordahl |Lin94j investigated the spatial Prisoner's 
Dilemma game with strategies of different memory lengths. Spatial structure has been 
identified as one possible mechanism to promote cooperation Now92 . In general, spa- 
tial game theory is capable of rich dynamical behaviour [Sza99, Szo04, Sza05, Tra04 , as 
coarsening, segregation, and spiral waves. Likewise, models for opinion dynamics have 
been studied, as the Sznajd model [SznOOj . 

2.3. Evolutionary dynamics on graphs. The systematic understanding of evolutionary 
dynamics on graphs is a still developing field. An early investigation of coevolutionary 
dynamics (i.e., including frequency-dependence) on graphs has been given by Ebel and 
Bornholdt Ebe02|, investigating the iterated Prisoner's Dilemma on networks. On the 
small-world architecture, Szabo et al. [Sza04j investigated the Rock-Paper-Scissors game 
dynamics. In Lic05, Oht06 , fixation properties of evolutionary dynamics on graphs are 
studied, and special subgraphs have been identified to enhance or suppress fixation. For 
two strategies and non frequency-dependent fitness, Antal, Redner and Sood |Ant06j have 
provided exact results for fixation for the case of degree-uncorrelated graphs. Despite 
this significant progress [S za0 7] , a general theory of coevolutionary dynamics on graphs 
remains a formidable challenge. 

2.4-. Unstructured population dynamics: Meanfield approach, or Polya urn models. The 
approximation of an unstructured population implies that individuals are undistinguish- 
able (apart from their strategies or genotype), and individuals are chosen randomly from 
the population, for death, reproduction, and competition. Hence, the population can be 
viewed as a Polya urn from which individuals are drawn for the stochastic process. All 
evolutionary processes discussed for finite populations in the remainder belong to this 
class of processes. 
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3. Microscopic evolutionary processes Evolutionary processes have been widely 
considered in population genetics. For processes in discrete time, an important systematic 
distinction has to be made between synchroneous or parallel |Baa97j update processes, 
as the Fisher- Wright process, and processes with overlapping generations, where one 
individual is replaced in each evolutionary step (see Fig. [IJ . 

3.1. Fisher-Wright process. The process defined by Fisher |Fis30j and Wright (Wri31j in 
its original form is not frequency-dependent; the fitness of the individuals does not depend 
on the state of the population (given by the number of individuals in each of the strate- 
gies). The Fisher- Wright process is defined as follows. In each time step, all individuals 
reproduce with probabilities proportional to their fitness, until the same population size 
N is reached. An important case is given by neutral evolution, where all individuals have 
identical fitness. Hence, the discrete stochastic process that describes the time evolution 
resembles a random genetic drift, and no Darwinian principle is incorporated. 
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Figure 1: Discrete stochastic evolution processes: Fisher- Wright process (left) as a typi- 
cal synchroneous update process, and an overlapping generations process (right). In the 
Moran process and Local update the lifetime of the individuals however is nonidentical, 
due to the stochastic asynchroneous update. For the transition probabilities see text. 
The open and closed bullets can represent two different strategies (in a social system), or 
two different alleles at a specific genetic locus (in biology). The generalization to higher 
numbers of strategies or genetic types is straightforward. 



Of course the Fisher- Wright process can be straightforwardly generalized to the case 
where the fitness of strategies depends on payoff gains obtained from game-theoretic in- 
teractions with other individuals. The finite population case has been considered recently 
by Taylor and Nowak [jTay06| ■ Here the transition matrix of the Markov process is by no 
means sparse; apart from the absorbing boundaries all matrix elements can be nonzero. 

3.2. Discrete stochastical processes for overlapping generations. The evolutionary pro- 
cesses of Moran or Local update type provide us with a transition probability T ± that 
the number of individuals i (being in the first strategy) increases or decreases by one, 
respectively. 

For definiteness, we consider explicitly the Moran evolution dynamics in arbitrary 
2x2 games |Cla05j . Given a finite population of N agents (two types/strategies A and B) 
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interacting via in a game with the payoff matrix 

In the frequency-dependent Moran process, Every agent interacts with a representative 
sample of the population, yielding the payoffs of A and B individuals as 

a, . a(i-l) + b(N - i) 

(7) Ti A {i) = l-w + w K 



B , ^ci + d(N-l-i) 



N - 1 

r i -U r 

(8) 7r"(i) = l-w + w y | 

« is the number of ^4 individuals, and 1 — w is a background fitness. 

5.5. Moran process. In its original form, also the Moran process |Mor62| is not frequency 
dependent. In this birth-death process, in each time step an individual is selected for 
reproduction, and subsequently a randomly selected individual dies. Hereby it is ensured 
that the total number of individuals N remains constant. 

For two strategies, the Moran process therefore is a one-dimensional Markov process 
with a finite number of states from i = 0, . . . , N. Taking up the Moran approach, Nowak, 
Taylor, Fudenberg and Sasaki Now04. Tay04 investigated a frequency-dependent Moran 
process, defined as follows: In the frequency-dependent Moran process, selection for re- 
production is proportional to the payoff compared to the average payoff, n A (i)/ (n). The 
probability per time step that a copy of an A agent is newborn then is p + i/N (with 
p + as given in Table [1]) . It replaces a randomly chosen individual. Hereby, the fitness 
is evaluated after each individual took interaction according to a payoff matrix with all 
individuals in the population. 

3.4- Local update and imitation processes. An apparent limitation of the Moran process 
with respect to biological situations is that individuals in each update step have to com- 
pete with the whole population (or, in real systems with a representative sample) of the 
population. 

A more realistic setting is given by local or pairwise compctetive interactions, which 
can be called imitation dynamics [HofOO] (in the concept of social strategies) or local up- 
date. These processes can be defined in a slightly different manner. In a non-symmetric 
definition of the (linear) local update process |Tra05j . one individual is selected for re- 
production, and the other for death. Then the strategy of the reproducing individual is 
changed (or kept) with probabilities that depend linearly on the difference of the payoffs 
of the two interacting individuals. Hereby, as is usually assumed in evolutionary game 
theory, the payoffs are evaluated by playing (on a shorter time scale) with the whole 
population, so these payoff differences still are evaluated in a global process. 

3.5. Nonlinear response: Local Fermi process. A variant |Blu93| ISza98l IHau05j of the 
Local update process arises naturally when the game interaction payoff is one of many 
additive contributions to the reproductive fitness. In the case where the external contribu- 
tions are large, and consist of many degrees of freedom that act like an external heatbath, 
the payoffs of the individuals appear as argument of Boltzmann factors, where a parame- 
ter w can be introduced as for the other processes (w — ► corresponds to weak selection) , 
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Tabic 1 : Comparison of three microscopic update processes and their respective differen- 
tial equations for x :— i/N obtained in the deterministic limit of N — > oo (see Sec. 15. 2|) . 



Moran process 



Local update 



Fermi process 



W 7T A - 7T? 



1 



1 



1 



P = 



1 — W + w(lTi) 

1 — w + wnf 

1 — W + w(lTi) 



P = 



P = 



2 2 

1 W IT 



Att- 



max 



2 A7T r 



p = 



1 _|_ e — w(nf — Trf ) 
1 

1 _)_ e -™Of — irf) 



< w < 1 



< w < 1 



< U! < oo 



Transition probabilities 
for increase/decrease of i: 



T 



i N 



: P 



N N 



i N- 



i N- 



N N 



In the N — > oo limit: 
. _ - a;)(7r^ - 7rf ) 

1 — w + w{n(x)) 
adjusted replicator eq. 



Wx(l - x)(tT x - 7rf ) 



i = x(l — x) tanh( — (tTx 



ordinary replicator eq. replicator eq. after JraOGc 



and here can be interpreted as a temperature. This pairwise comparison process has been 
studied in detail in |Tra06c[ lTra07j . See Table [T] for the transition probabilities of the 
Moran process, Local update, and Fermi process. 

4. Broadening of distributions in finite populations. For the Moran process, the 
strategy distribution is generated only by the inherent stochasticity of the finite popula- 
tion. At the borders, for To^i and T/v^at^i we assume a small mutation rate \x |Fud04j . 
While in the infinite population case the population density is peaked at the determinis- 
tic trajectory in the sense of a delta distribution, for a finite population it is broadened. 
Fortunately, the Moran process allows for an analytical treatment. The stationary distri- 
bution for an arbitrary payoff matrix can be expressed via Pochhammer symbols, rising 
factorials or gamma functions, for the general case of 2x2 games including nonvanishing 
background fitness [Cla05j . For illustration, let us consider the special cases of neutral 
evolution, constant fitness, an 'anticoordination game' and the Prisoner's dilemma, 

"-{: :> '-(: :)• M! MS 0- 

Internal (mixed) vs. external (pure) Nash equilibrium. For frequency dependent fitness 
and w > 0, the game can have an internal Nash equilibrium or an equilibrium in one 
of the absorbing states. A simple example with an internal Nash equilibrium is the 

'anticoordination' game with w = 1, P = ^ ^ )' t ransn ^ on matrix here is 

Ti^i + \ = ^^,Ti_>i_i = 2^f, describing a random walk with a drift towards the de- 
terministic fixed point i = N/2. In equilibrium, we have Pi Ti_>j_|_i = Pj+i Ti+i^i for 
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every i, thus 

3=0 J V 7 

Pi is a binomial distribution around the equilibrium of the replicator dynamics. 

The Prisoner's Dilemma has a Nash equilibrium for mutual defection, i.e. i = 0. At the 
borders, for Tq^i and Tjv— >jv-i we assume a small mutation rate 11 |Fud04j . As 6 = 0, also 
state i = 1 is absorbing for w = 1 (two cooperators are needed to promote cooperation) . 
Thus a small mutation rate ri has to be assumed also for 7i^2- Alternatively one could 
assume w < 1. 

Table 2: The four payoff matrix cases considered in Fig. [2] under the assumption of a small 
mutation rate (see text). Without the frequency-dependence introduced by a game, the 
cases of constant fitness and neutral evolution known from mathematical genetics are 
recovered; the distribution keeps localized (for low mutation rates, mutants stay rare). 
For the analytical expressions of the distributions see |Cla05j . The distributions follow 
approximately a stretched exponential with the fit exponents 7 as given in the table. 



Payoff matrix 


Distribution ss exp(— bx 1 ) 


Nash equilibrium (NE)? 


a = b = c = d 
Neutral evolution 


p ~ 1 


drift — > i = and — > i = N 


a = b < c = d 
constant fitness 


~ exponential 7 = 0.87 


drift -> i = 


Pac = 


(11) 




~ binomial 7 = 2.07 


i = N/2 "internal NE" 


PPD = 


(ID 




7 = 0.63 


i = "external NE" 



The four cases are summarized in Table [21 For neutral evolution the decay is very 
slow. With constant fitness, the probability decays approximately exponentially. For the 
Prisoner's dilemma, the decay becomes slower with larger distance, while it becomes faster 
for the binomial distribution at the internal Nash equilibrium. The distributions are shown 
in Fig. [21 The decay of the distribution can be fitted by a P « exp(— 6x 7 ), jac — 2.06, 
Icf — 0.87, jpd = 0.63. This corresponds to random motion in an anharmonic potential. 

5. From microscopic equations to macroscopic equations Corresponding to the 
discreteness of states, we first describe the processes by a master equation, then formulate 
a Fokker-Planck (Kolmogorov forward) equation for large N, and finally compare the 
deterministic equations resulting from the limit N — > 00. 

5.1. Limit of large populations: From Master equation to Fokker-Planck equation. The 
equation of motion (or time evolution equation) for the stochastic process can be formu- 
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Figure 2: Reproduced from [Cla05] . The invariant distributions Pj share different decay 
tails as a function of the distance j — j max from the Nash equilibrium j max . Here r = 
1 — w + wa. In the four cases considered here (shown for N = 100), the distributions 
can be approximated by stretched exponentials (which would appear as straight lines in 
appropriate scaling, the inset shows that the approximation is reasonable). For higher 
mutation rates see |Tra06aj . 

lated in terms of the master equation 

(10) P T+1 (i) -P T (i) = P T {i-l)T+(i-l)- P T (i)T-(i) 

+ P T {i + l)T~(i + 1) - P T {i)T+(i) 

for the probability distribution, i.e., P T (i) is the probability to be in state i at time r. For 
./V 3> 1 we can proceed via a Kramers-Moyal expansion, defining x = i/N and t = r/N. 
Then a formal Taylor expansion of T and p{x, t) = N P T (i) yields, considering only the 
two leading terms of the Taylor expansion, 

(11) j t p{ - x,t) = ~ic [a{ - x)p ( x,t)]+ \ix* [^w*'*)] 

(12) a(x) = T + (x)-T-(x) 

(13) b(x) = ^1 [T+(x)+T-(x)]. 

For large, but finite N, this equation has the form of a Fokker-Planck equation. This 
allows to generalize the diffusion approximation (see e.g. [DroOl] ) to coevolution. Since 
the internal noise is not correlated in time as subsequent update steps are independent, 
according to the ltd calculus a corresponding Langevin equation reads 

(14) x = a(x) + b(z)£ 

where ^ is uncorrelated Gaussian noise and b(x) = for x = and x = 1. We here see 
that the noise is multiplicative and frequency-dependent. 
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5.2. Limit of infinite populations: Replicator equation and Adjusted replicator equation. 
The leading order term does not vanish and describes the deterministic drift term. 
Surprisingly, the replicator equation |Tay78[ [Hof79 , Zee81j 

. wx(l - x)(ir£ - 7T?) 

(15) x = x — 

is obtained for the Local update process |Tra05| , whereas the adjusted replicator equation 

(16) ± = ™f-*)(^-«J) 

I — w + w{Tr(x)} 

is the deterministic limit of the Moran process [Tra05j. For other processes, other differ- 
ential equations may be obtained, see Table [U 

The difference between the two equations may be best illustrated for the Prisoner's 
Dilemma. Here the (ordinary) replicator dynamics reads x — —x(l — x 2 ), whereas the 
adjusted replicator dynamics reads x — l-Z^ 1 "^ - x? ■ In this case, the stability of fixed 
points is preserved, as the additional denominator can be absorbed into a dynamical 
rescaling of the time scale, commonly known as velocity transform. However, in asym- 
metric conflicts the change of time scale matters, as will be detailed in the next section. 

6. Asymmetric and cyclic games. Cyclicity of evolutionary dynamics intuitively is 
contradictory to the oversimplified picture of an absolute fitness landscape: any species 
having reached the maximal fitness value within a population will outcompete all others, 
and no cyclicity or oscillation can emerge. However, in ecological competition, oscillations 
of populations are quite generic, as known since Lotka [Lot20j and Volterra |Vol26j (see 
also |Mur04j ) . Of special interest are cases where species cyclically outcompete each other, 
as in Dawkins' caricature of mating strategies (see Sections 16. 1H6.2|) . or the children's 
game Rock-Paper-Scissors, where rock crushes scissors, paper covers rock, and scissors 
cuts paper. This situation has been spotted in the territorial behaviour of lizards Sin96 ( 
IZamOO] . and also in E.coli bacteria in vitro |Ker02j and in vivo [Kir04j . The Fokker-Planck 
equation, in analogy to Sec. 15. 11 for the Rock-Paper-Scissors game has recently been given 
in |Rei06j , and generalizations to other cyclic evolutionary games are straightforward. It 
is generally claimed that such cyclic coevolution promotes biodiversity [Csa02, Cla08j. 
However, its relevance in a more general picture of "evolution at large" remains an issue 
still to be investigated. 

6.1. Asymmetric conflicts (bimatrix games). As mentioned in the introduction, the pay- 
off matrix for the opponent can be different from that earned by the first player. To set 
this scenario into work, it is usually required that the game is played between two disjunct 
populations (as below, female and male), or that the interaction process itself is asym- 
metric, e.g., that one player is "initiative" and gains payoffs different from those earned 
in the opponents' role. Many social and economic situations bear such asymmetries, but 
they are often too weak to be significantly extracted from data. 

An illustrative example of biological mating behaviour has been given by Dawkins 
Daw76\ Male and female each can occur with two genetic strategies, "fast" (male: phi- 
landerer, female: "fast") and "slow" (male: "faithful", female: "coy"). The payoff benefit 
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of a child is assumed to be b for both parents, the total cost of raising an offspring is 
(—2c), and the prolonged courtship that coy females insists on add a burden of a to both 
parents. Coy females and male philanderers produce nothing and gain nothing. The cost 
(—2c) is covered by both parents, except for philanderer males and fast females, where 
the female has to growup its offspring alone. This translates into the payoff matrix (with 
usual parameter choices a = 3,fe=15,c=10, see also Fig. |3|) 



(17) «,<) 



(6 - c - a,b- c - a) (b - c, b - c) \ _ / (2, 2) (5, 5) 
(0,0) (b, b -2c) ) ~ { (0,0) (15,-5) 

If the four conditions a > 0, c > 0,6— c > 0, 2c — a — 6 > are fulfilled, the game is 
cyclic. These conditions correspond to the arrows in Fig. [3] The cyclicity of the game is 
preserved if we consider a normalized version (being equivalent to the payoff matrix of 
"Matching Pennies" played by two players): 

' (+1,-1) (-!,+!) ' 
(+1,-1) 

For the cyclicity refer to Fig. [3J Let the cycle start in the lower right corner, where fast 
females and male philandrers are present. If males are philanderers, it pays for females to 
be coy (lower left corner); insisting on a long courtship period to make males invest more 
in the offspring (upper left corner). However, once most males are faithful, fast females 
are favored avoiding the costs of courtship (upper right corner). Subsequently, the male 
investment into the offspring is no longer justified, philanderers are again favored (lower 
right corner), and the cycle continues. 
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Figure 3: Asymmetric payoff matrices for the Battle of the Sexes [Daw76] . Left: Original 
payoff matrix suggested by Dawkins. Right: Simplified payoff matrix, identical to the 
game "Matching pennies" . In both cases, the left entry is for the row player, and the right 
entry (upon a common convention, shifted upwards, to enhance intuitive assignment) is 
for the column player. Arrows indicate the cyclic dominance. 

This game exhibits neutrally stable periodic orbits |May87] when described by the 
usual replicator equation approach [Tay78, Hof79, IZee81j . This would, according to 
Dawkins, lead to an infinitely lasting oscillation of strategies. As Dawkins argues, certain 
species (gibbon, stickleback, duck, fruit fly) have, in the course of real evolution, chosen 
to follow a fixed pair of strategies; for them the "Battle of the Sexes" has come to a rest. 
Of course this models relies on several assumptions, and in the remainder we will analyze 
how the conclusions change when considering different evolutionary processes and when 
explicitly considering the finiteness of the population. 
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Figure 4: Reproduced from [TraOSj. Drift reversal in the asymmetric game "Battle of 
the Sexes". Shown is the average change of H (which is a constant of motion in the 
ordinary replicator equation) for different population sizes, (a) For the Moran process 
(circles) above a critical population size the average change of H becomes negative so 
that trajectories spiral outwards on average. For the Local update, no drift reversal is 
observed and for N — > oo the change of H approaches zero (shown in the inset in double 
logarithmic plot), (b): Scaling of the critical population size with selection pressure w. 



6.2. Counterintuitive behaviour for the "Battle of the Sexes". The case of asymmetric 
conflicts opens the possibility of a conterintuitive finite-size effect: The sign of the aver- 
age of H = —xy(l — x)(l — y) (being a constant of motion for the ordinary replicator 
equation) changes for the Moran process above a critical population size, whereas the 
change remains positive (spiraling outwards) for the Local update and Fermi process in 
all finite populations (Fig.HJ) |Tra05| [Cla06| ICla07j . Hence in the N -> oo limit the Moran 
process shows a deterministic behaviour (that of the adjusted replicator equation), which 
is qualitatively different from that of the ordinary replicator equation. The reason is that 
the common velocity transformation, which can absorb the normalization denominator of 
the average fitness, here cannot be performed, as female and male population earn differ- 
ent payoffs and the denominators no longer coincide. The adjusted replicator equations 
here read 

in (x 2 -x)(2y-l) 



(19) 



<* + (2y-l)(2x-l) 
(y 2 -y)(2x-l) 



m * " - a ^-(*-i,(*-i)- 

Hence, if the two populations earn different average payoffs (here they differ by a factor 
— 1), the fixed point stability of both types of replicator equations can differ. 
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